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CLAIMS 

1. A metBod to estimate head motion between two images of a face, the 
method comprising operations of: 

identifying locations of a plurality of distinct facial features in the two 
images, the locations corresponding to a number of unknowns determined upon 
estimation of head motioi^ the number of unknowns being determined by a 
number of equations; 

converting the identified locations into a set of physical face parameters 
based on the symmetry of trap distinct facial features, the set of physical face 
parameters reducing the number of unknowns as compared to the number of 
equations used to determine the|unknowns; and 

from identified points in the two images, the 
the set of physical face parameters. 



estimating head motioi 
identified points being based oi 



v 

^2. A method\s recited in claim 1, wherein the operation of estimating 
head motion further composes: 

calculating an estimation objective function comprising a set of terms to 
estimate: (a) each of the let of physical face parameters, (b) a first head pose 
transform corresponding tp the first image, and (c) a second head pose transform 
corresponding to the second image. 
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3, A method as recitefl in claim 1, further comprising after the operation 
of converting and before the operation of estimating, an operation of: 

adding an inequality constraint on a particular face parameter of the 
physical face parameters, such that the particular face parameter is constrained 
within a predetermined minimun^and maximum value. 

fjT ^*\4. A metho\as recited in claim 3: 

wherein the particular face parameter corresponds to the nose tip; and 
wherein the predetermined minimum value is zero (0) and the 

predetermined maximum val\e is a reasonable value based on absolute values of 

other of the locations. 

5. A method as recited in claim 3, further comprising converting the 
inequality constraint to an equality constraint using a penalty function. 



6. A method as recited inlclaim 1, wherein the operation of estimating 
head motion further comprises operations of: 

calculating an estimation objective function to determine an initial estimate 
of head rotation, the estimation objective function comprising a set of terms to 
estimate: (a) each of the set of physical face parameters, (b) a first head pose 
transform corresponding to the first ipiage, and (c) a second head pose transform 
corresponding to the second image; 

placing an inequality constraint on a particular face parameter of the set of 
physical face parameters, such thatlthe particular face parameter is constrained 
within a predetermined minimum andVnaximum value; 
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converting the inequality\onstraint to an equality constraint using a penalty 
function; and 

adding the equality constraint^ the initial estimate [estimation system]. 

7. A method as recited inlclaim 1, wherein the identified locations 
correspond to the eye corners, mouth corners and nose tip. 

8. A method as recited in claim 2, wherein in the operation of estimating 
the head motion further comprises an operation of multiplying each term of the 
estimation objective function by a weighted contribution factor based on the 
confidence of data corresponding to the! estimation objective function. 

9. A method as recited in clq|m 5, wherein in the operation of providing 
further comprises operations of: 

multiplying each term of the estimation objective function and the equality 
constraint by a weighted contribution factor based on the confidence of data 
corresponding to the estimation obj/ctive function. 



10. A method as reeled in claim 1, wherein the identifying comprises 
accepting input from a humajjf user. 

11. A computer-readable medium storing computer-executable 
instructions that, when executed on a computer, performs the method of claim 1 . 
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12. One or more computer-readable media containing a program that is 
executable by a computer to estimate motion between two images, the program 
comprising the following actions: 

determining locations of a plifrality of distinct features in the two images; 
converting the identified locations into a set of parameters based on the 
symmetry of the distinct features; anc 

estimating motion between th^ two images based on the set of physical face 
parameters. 



13. One or more compuler-readable media as recited in claim 12, 
wherein the estimating motion furthet comprises: 

calculating an estimation objective function comprising a set of terms to 
estimate: (a) each of the parameters, m) a first transform corresponding to the first 
image, and (c) a second transform corresponding to the second image. 



^^^"714. One orVnore computer-readable media as recited in claim 13, 

wherein in the estimating further comprises multiplying each term of the 

estimation objective functron by a weighted contribution factor based on the 
confidence of data corresponding to the estimation objective function. 



15. One or more computer-readable media as recited in claim 12, after 
converting and before estimating, further comprising: 

adding an inequality constraint on a particular parameter of the parameters, 
such that the particular parameter is constrained within a predetermined minimum 
and maximum value. 
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16. One or more cWputer-readable media as recited in claim 15: 
wherein the predetemined minimum value and the predetermined 

maximum value are based on absolute values of other of the locations. 

17. One or more compiler-readable media as recited in claim 1 5, further 



comprising converting the inequz 
penalty function. 



ity constraint to an equality constraint using a 



18. One or more conputer-readable media as recited in claim 12, 
wherein the estimating further comprises: 

calculating an estimation Objective function to determine an initial estimate 
of image rotation, the estimation objective function comprising a set of terms to 
estimate: (a) each of the parameters, (b) a first pose transform corresponding to the 
first image, and (c) a second pose transform corresponding to the second image; 

placing an inequalitwconstraint on a particular parameter of the parameters, 
such that the particular parameter is constrained within a predetermined minimum 
and maximum value; j 

converting the inequality constraint to an equality constraint using a penalty 
function; and / 

adding the equality constraint to the initial estimate. 



25 
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19. One or moreVcomputer-readable media as recited in claim 18, 
wherein in the calculating furtnfer comprises: 

multiplying each term ofYhe estimation objective function and the equality 
constraint by a weighted contribution factor based on the confidence of data 
corresponding to the estimation objective function. 

20. One or more compeer-readable media as recited in claim 12, 
wherein the identifying comprises accepting input from a human user. 



21. A methoctao estimate head motion between two images of a face, the 
method comprising operations of: 

identifying locations of a plurality of distinct facial features in the two 
images, the locations corresponding to a number of unknowns determined upon 
estimation of head motion, th^ number of unknowns being determined by a 
number of equations; 

converting the locations irfto set of physical face parameters based on the 
symmetry of the identified distnct facial features, the set of physical face 
parameters reducing the number of unknowns as compared to the number of 
equations used to determine the unknowns; 

determining an initial estimation of head motion between the two images 
using the set of physical face parameters; and 

refining the estimation |f head motion by incorporating the initial 



estimation into a feature matching 



algorithm. 
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£j^^22. A metn^d as recited in claim 21, wherein the identified locations 
correspond to the eye confers, mouth corners and nose tip. 

23. A method as refcited in claim 21 , wherein the identifying comprises 
accepting input from a human user. 



24. A method as recitediin claim 21, further comprising multiplying the 
refined head motion estimate by a confidence factor that indicates that each of the 
identified locations was identified wilh a same level of accuracy. 



25. A method\s recited in claim 21, wherein determining an initial 
estimate of head motion compri^s^ calculating an estimation objective function 
comprising a number of terms h estimate each of: (a) the set of coordinates, (b) a 
first head pose transform corresponding to the first image, and (c) a second head 
pose transform corresponding tc\the second image. 



f ^^T\ 26. A method as recited in claim 25, wherein in the operation of 
determining further comprises multiplying each term of the estimation objective 
function by a weighted contribution factor based on the confidence of data 
corresponding to the es timation objective function. 
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27. A method as recited in claim 21, after the converting and before the 
determining, further conWising: 

adding an inequality constraint on a particular parameter of the physical 
face parameters, such thatlthe parameter is constrained within a predetermined 
minimum and maximum vali 



28. A method as recited in claim 27: 

wherein the particular parameter corresponds to the nose tip; and 
wherein the predetermined minimum value is zero (0) and the 

predetermined maximum valu^J is a reasonable value based on absolute values of 

other of the locations. 



29. A method as recited in claim 27, further comprising converting the 
inequality constraint to an equanty constraint using a penalty function. 



30. A method as recited in claim 21, wherein the determining further 
comprises: 

calculating an estimation objective function to comprising a set of terms to 
estimate each of: (a) thejphysical face parameters, (b) a first head pose transform 
corresponding to the /first image, and (c) a second head pose transform 
corresponding to the second image; 

adding an inequality constraint on a particular parameter of the physical 
face parameters, such that the particular parameter is constrained within a 
predetermined minimum and maximum value; 
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converting the inequality constraint to an equality constraint using a penalty 
function; and 

adding the equality constraint to the initial estimate. 



31. A method as 
providing further comprises 



recited in claim 30, wherein in the operation of 
perations of: 

multiplying each ternfi of the estimation objective function and the equality 
constraint by a weighted contribution factor based on the confidence of data 
corresponding to the estimation objective function. 



32. A computer-readable medium storing computer-executable 
instructions that, when executed on a computer, performs the method of claim 2 1 . 



33. A method to estimate motion between two images, the method 
comprising operations of: 

identifying locations <3f a plurality of distinct features in the two images, the 
locations corresponding to symmetrical features shared between the two images, 
the locations corresponding to anumber of unknowns determined upon estimation 
of motion between the two imag|s;^^ 

converting the locations iflto a set of parameters based on the symmetry of 
the identified distinct features, tne parameters reducing the number of unknowns 
as compared to a number of equations used to determine the unknowns; and 
estimating motion between the two images using the parameters. 
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34. A method £^ recited in claim 33, wherein the estimating further 
comprises: 

providing an initial estiViate of image rotation by estimation of each of the 
parameters, a first image pose transform corresponding to the first image, and a 
second image pose transform corresponding to the second image; 

adding an inequality constraint on a particular parameter of the parameters, 
such that the particular parameter i^constrained within a predetermined minimum 
and maximum value; \ 

converting the inequality constraint to an equality constraint using a penalty 
function; and 

adding the equality constraint tdjthe initial estimate. 

35. A method as recited in tplaim 33, wherein the estimating further 
comprises calculating an estimation otSjective function comprising a number of 



terms to estimate each of: (a) the par 



meters, (b) a first image pose transform 



corresponding to the first image, a£d (c) a second image pose transform 
corresponding to the second image. 



36. A method a& recited in claim 35, wherein in the operation of 



prise^ 



providing further comprisesV an operation of multiplying each term of the 



estimation objective function 



confidence of that correspondi ig data 



by a weighted contribution factor based on the 
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37. A method a&recited in claim 33, after the converting and before the 
estimating further comprising? 

adding an inequality constraint on a particular parameter of the physical 
face parameters, such that the particular parameter is constrained within a 
predetermined minimum and maximum 

38. A method as recited in claim 37, further comprising converting the 
inequality constraint to an equality constraint using a penalty function. 

j/^^*"^?^ A method^ recited in claim 34, further comprising: 

multiplying each terr\of a set of terms used to determine the initial estimate 
by a weighted contribution factor based on the confidence of data corresponding to 
the initial estimate. 

40. A computer-readable medium storing computer-executable 
instructions that, when executed on \ computer, performs the method of claim 33. 



41 . A method^pmprising: 

identifying locationsiof a plurality of distinct features in two images, the 
locations corresponding to s^nimtrical features shared between the two images, 
the locations being identified iifta first coordinate system; 

converting the locations imto a second coordinate system that is based on the 
symmetry of the identified distirfipt features, the locations being described by a set 
of coordinates in the second coordinate system; and 
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determining a motion^ estimate between the two images using the set of 
coordinates. 



42. A computer-readable medium storing computer-executable 
instructions that, when executed on a computer, performs the method of claim 41 . 
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